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Abstract 


The E-Learning Maturity Model (eMM) is a quality improvement framework 
designed to help institutional leaders assess their institution's e-learning maturity. 
This paper reviews the eMM, drawing on examples of assessments conducted in 
New Zealand, Australia, the UK and the USA to show how it helps institutional 
leaders assess and compare their institution's capability to sustainably develop, 
deploy and support e-learning. 


Resume 


Le modele de maturite pour Tapprentissage en ligne (E-Learning Maturity Model 
(eMM)) est un cadre de reference sur T amelioration de la qualite qui est congu 
pour aider les leaders institutionnels a evaluer la maturite de leur etablissement 
en lien avec Tapprentissage en ligne. Cet article passe en revue le eMM, en tirant 
des exemples devaluations qui ont ete menees en Nouvelle-Zelande, en 
Australie, au Royaume-Uni et aux Etats-Unis afin de montrer comment cela aide 
les leaders institutionnels a evaluer et a comparer la capacite de leur etablissement 
a developper de fa^on durable, a deployer et a soutenir Tapprentissage en ligne. 


Introduction 

Investment in e-learning by educational institutions has grown rapidly, 
driven at least in part by the expectation that increased use of technology 
will improve the quality and flexibility of learning (Bush 1945; 
Cunningham et al. 2000; Bates 2001; Cuban 2001; DfES 2003; 
Oppenheimer 2003) combined with a changing focus on learners rather 
than teachers and institutions (Oblinger & Maruyama 1996; Buckley 2002; 
Laurillard 2002). In a recent Sloan survey (Allen & Seaman, 2006) 
approximately 60% of US college Chief Academic Officers felt that 
e-learning was "critical to the long-term strategy of their institution." 

This investment has been supported by the widespread adoption of 
Learning Management Systems (Zemsky & Massy, 2004) as well as the 
computerization of other key administrative functions (Hawkins & Rudy, 
2006, p. 52) and the investment of internal and external funding on 
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e-learning project work (Alexander 1999, Alexander & McKenzie 1998). 
There has been a growing recognition that a mature and integrated 
institutional infrastructure is needed to ensure reliable and cost-effective 
provision of e-learning opportunities to students (Reid, 1999; Holt et al., 

2001) . Whether significant improvements in the quality of the student 
experience have been achieved remains, however, unclear (Conole, 2000; 
Kenny, 2001; Radloff, 2001; Taylor, 2001; GAO 2003; Zemsky & Massy, 
2004). 

Institutional leadership must consider the implications for e-learning 
of resource utilization (Karelis 1999), sustainability (Strauss 2002; Young 

2002) , scalability and reusability (Bain 1999; IEEE 2002; Boyle 2003) and 
management (Laurillard 1997; Reid 1999). There is a need for leadership, 
guidance and vision in implementing e-learning that delivers real 
educational value to students while also being sustainable for the 
institution in the long term (Strauss, 2002). 

Failures such as that of the UK e-University (Garrett, 2004) and the US 
Open University (Meyer, 2006) illustrate the challenges that face 
organizations depending on technology for the delivery of programmes. 
While the large scale educational benefits of e-learning remain difficult to 
demonstrate, the use of IT systems for business and administrative 
activities has become mainstream, and even strategically irrelevant as 
differentiators between organizations (Carr, 2003). 

The need to ensure that the organisational aspects of e-learning are 
supported as well as the pedagogical and technological is now being 
recognised (Ryan et al. 2000; Bates 2001) and this includes an 
understanding of the wider, systems context within which e-learning is 
situated (Laurillard 1997, 1999; Ison 1999) and the need for leadership, 
strategic direction and collaboration within an organization (Hanna 1998; 
Reid, 1999). Woodill and Pasian's (2006) review of the management of 
e-learning projects demonstrates the limited extent to which formal 
project management tools and systems are currently evident. 

In essence, a development of organisational maturity is needed for 
institutions to benefit from their investment in e-learning. Organizational 
maturity captures the extent to which activities supporting the core 
business are explicit, understood, monitored and improved in a systemic 
way by the organization. Organizational maturity in the context of 
e-learning projects requires a combination of capabilities. As well as a 
clear understanding of the pedagogical aspects, project teams must be 
able to design and develop resources and tools, provide a reliable and 
robust infrastructure to deploy those resources and tools, support staff 
and students using them, and finally place their efforts within a 
strategically driven environment of continuous improvement. While 
individual staff may be enthusiastic and skilled, the ability of an 
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institution to support and develop this wider set of capabilities is key to 
the ongoing sustainability of their work. In the context of the eMM, 
institutions that have greater organization maturity in e-learning are 
described as having greater capability (see below). 

Laurillard (1997) has noted that the challenge in stimulating the 
effective use of e-learning resources and approaches beyond early 
adopters is to identify the limitations of current practices and 
consequently how strength in e-learning capability can be incrementally 
improved. Systematic and incremental improvement must encompass 
academic, administrative and technological aspects (Jones, 2003) 
combined with careful integration into the strategies and culture of the 
institution (Remeyni et al., 1997). As noted by Fullan: 

The answer to large-scale reform is not to try to emulate the characteristics 
of the minority who are getting somewhere under present conditions . . . 
Rather, we must change existing conditions so that it is normal and 
possible for a majority of people to move forward (Fullan 2001, p. 268) 

The rapidly evolving nature of the technologies used for e-learning is 
an additional challenge. Technologies that are useful today are likely to be 
supplanted or significantly modified in a very short timeframe and new 
technologies are constantly being introduced in ways that redefine the 
opportunities available. This constant flux requires flexibility and an 
openness to change if institutions are to be responsive to the potential 
opportunities (Hamel & Valikangas, 2003). Institutions need an 
environment where the processes used to design, deploy and sustain 
e-learning are robust and effective, rather than ad-hoc and dependent on 
the energies and skills of particular individuals. 

This challenge is not unique to e-learning and has similarly been 
encountered in the wider field of software engineering. Gibbs (1994) 
described the activities of those creating software in the late eighties and 
early nineties as "They have no formal process, no measurements of what 
they do and no way of knowing when they are on the wrong track or off 
the track altogether." This criticism could easily be made of the e-learning 
activities undertaken in many educational institutions today. 

Process Maturity Models 

One of the ways that the problem of improving the quality of software 
development was addressed was through the use of process 
benchmarking. Rather than focusing on particular technologies and 
measures, process benchmarking examines the quality and effectiveness 
of the systems and processes used to select, develop, deploy, support, 
maintain and replace technologies (Humphrey 1994). 
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In the field of software engineering, the Capability Maturity Model 
(CMM, Paulk et al. 1993) was developed to provide a framework for 
process benchmarking. The CMM proposed that organizations engaged 
in software development moved through five levels of "Maturity" in their 
process capabilities (Paulk et al. 1993). The CMM has been very successful 
in stimulating improvements in software development (SEI, 2008) and 
transfer of good practice between projects (Herbsleb et al. 1994; Lawlis et 
al. 1995). This success has seen a general adoption of the term 'maturity' 
to describe organisational effectiveness and a proliferation of maturity 
models in other domains (Copeland, 2003). 

Creation and Application of an e-Learning Maturity Model 

An educational version of the CMM, or e-learning Maturity Model 
(eMM), potentially has a number of benefits that were identified at its 
inception (Marshall and Mitchell, 2002) and which are evident to others 
working in the field (Griffith et al., 1997; Kirkpatrick, 2003; Underwood 
and Dillon, 2005): 

• Firstly, an eMM could provide a road map for higher education 
institutions looking to improve their e-learning processes. It could 
provide a clear model to guide the ongoing development of 
institutional resources and enhancement of support processes. 

• Support for institutional planning can be enhanced by the ability of 
an institution or smaller organizational unit to benchmark its 
current e-learning capability so as to identify and prioritise 
necessary improvements to its current processes. By focusing on 
key organisational processes an eMM allows for different technical 
platforms, management models, educational cultures and 
pedagogical beliefs. 

• The benchmarking information provided through an eMM can aid 
inter- and intra-institutional collaboration by allowing entities to 
identify areas in which improvements may produce the most 
immediate value as well as establishing a framework for 
collaboration on future initiatives. 

• As well as benchmarking, an eMM can also assist with 
organizational change by providing managers, academics and 
other practitioners with the necessary means to encourage greater 
institutional engagement with e-learning. An eMM can also 
provide University management with the framework necessary to 
communicate and guide long term institutional e-learning 
planning and change projects. 
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Perhaps most importantly, like the CMM, an eMM can form the basis for 
an ongoing discussion within the e-learning community with a view to 
identifying the key processes and practices necessary for achieving 
sustainable and robust improvements in the quality of e-learning 
experienced by students. 

International application of the eMM since its inception has seen many 
of these benefits realised and acknowledged publicly. Sector wide benefits 
are evident in the projects conducted in the UK (JISC, 2009; Sero, 2007) 
and New Zealand (Marshall, 2006a; Neal & Marshall, 2008) and in the use 
of eMM information to frame consideration of specific aspects of 
e-learning within sectors (Moore, 2005; Choat, 2006) including 
professional development of staff (Mansvelt et al., 2009; Capelli & 
Smithies, 2008). Individual institution's analysis of their capability 
(Petrova & Sinclair, 2005; University of London, 2008) is also matched by 
disciplinary specific activities (Lutteroth et al. 2007). 

Key Concepts of the eMM 

The following pages contain an abbreviated description of the eMM, 
further information can be found in Marshall (2006b) and on the eMM 
website: http: / / www.utdc.vuw.ac.nz/research/ emm/ 

Capability 

The most important concept embedded in the eMM is that of Capability, 
as this is what the model measures and it is designed to analyse and 
improve. Capability in the eMM builds on the more general concept of 
organizational maturity and incorporates the ability of an institution to 
ensure that e-learning design, development and deployment is meeting 
the needs of the students, staff and institution. Critically, capability 
includes the ability of an institution to sustain e-learning delivery and the 
support of learning and teaching as demand grows and staff change. 
Capability is not an assessment of the skills or performance of individual 
staff or students, but rather a synergistic measure of the coherence and 
strength of the environment provided by the organization they work 
within. 

A more capable organization, under the eMM, has coherent systems 
that address each of the key e-learning processes (see following), it 
monitors whether these processes are delivering the desired outcomes (in 
measures it defines for itself), helps staff and students learn and engage 
with the process activities and deliverables, and systematically improves 
process to achieve pre-defined improvements. 

A less capable institution engages in e-learning in an ad-hoc manner, 
with disconnected initiatives depending on the skills of individual staff. 
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duplication due to a lack of knowledge of the work of others, and 
improvement by chance or personal pride. Successful initiatives are lost 
as staff change and managers lack information on the outcomes 
experienced by students and staff. 

Capability is not just a function of whether the key processes are 
addressed. It is a summary of activities assessed over five dimensions that 
capture the organisational lifecycle associated with each key process. 

Dimensions of Capability 

Technology adoption models commonly present a hierarchical 
perspective of technology use by organizations. Models such as that 
proposed by Taylor (2001), Monson (2005) and the original CMM are 
designed and used in the presumption that technology use grows in 
complexity and effectiveness in an essentially linear, or progressive 
manner. The current version of the eMM, in contrast, has adopted the 
concept of dimensions to describe capability in each of the processes 
(Figure 1). Based on the original CMM levels, the five dimensions 
(Delivery, Planning, Definition, Management and Optimization) describe 
capability in a holistic and synergistic way. 
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Figure 1: eMM Process Dimensions 


The Delivery dimension is concerned with the creation and provision 
of process outcomes. Assessments of this dimension are aimed at 
determining the extent to which the process is seen to operate within the 
institution. 
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The Planning dimension assesses the use of predefined objectives and 
plans in conducting the work of the process. The use of predefined plans 
potentially makes processes more able to be managed effectively and 
reproduced if successful. 

The Definition dimension covers the use of institutionally defined and 
documented standards, guidelines, templates and policies during the 
process implementation. An institution operating effectively within this 
dimension has clearly defined how a given process should be performed. 
This does not mean that the staff of the institution understands and 
follows this guidance. 

The Management dimension is concerned with how the institution 
manages the process implementation and ensures the quality of the 
outcomes. Capability within this dimension reflects the measurement and 
control of process outcomes. 

The Optimization dimension captures the extent to which an institution 
is using formal and systematic approaches to improve the activities of the 
process to achieve pre-defined objectives. Capability of this dimension 
reflects a culture of continuous improvement. 

The dimensional approach avoids the model imposing a particular 
mechanism for building capability, a criticism that has been made of the 
original CMM (Bach, 1994) it also helps ensure that the objective of 
improving capability is not replaced with the artificial goal of achieving a 
higher maturity level. Organizations which have achieved capability in 
all of the dimensions of the eMM are, by definition, able to use the high 
level of awareness of their activities that the delivery, planning, definition 
and management dimensions provide to drive the efficient and flexible 
change processes measured by the optimization dimension. Indeed, a less 
capable organization may find themselves focusing on documentation 
and process over outcomes as a consequence of failing to address the 
concerns of the optimization dimension of individual processes. 

Processes 

Recognition of the potential offered by an eMM led to the development of 
an initial version (Marshall & Mitchell, 2003; 2004) building on the SPICE 
(Software Process Improvement and Capability Determination) 
framework (SPICE 1995). The process areas of the first version of the eMM 
process set was populated using the Seven Principles of Chickering and 
Gamson (1987) and the Quality on the Line benchmarks (IHEP, 2000) as 
outlined in Marshall & Mitchell (2004). These heuristics were selected as 
being widely accepted descriptions of necessary activities for successful 
e-learning initiatives. Obviously, it would be better to use empirically 
well-supported benchmark items with a substantial evidence base 
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proving their utility, however the weaknesses of the current e-learning 
evidence base (Conole et al., 2004; Mitchel, 2000; Zemsky & Massy, 2004) 
mean that heuristics must instead be used. A goal of this initial model was 
to start evaluating the utility of these initial processes so that they could 
be refined and expanded upon. 

The current version of the eMM (Marshall, 2006b) divides the 
capability of institutions to sustain and deliver e-learning into thirty five 
processes grouped into five major categories or process areas (Table 1) 
that indicate a shared concern. It should be noted however that all of the 
processes are interrelated to some degree, particularly through shared 
practices and the perspectives of the five dimensions. Each process in the 
eMM is broken down within each dimension into practices that define 
how the process outcomes might be achieved by institutions (Figure 2). 
The practice statements attempt to capture directly measureable activities 
for each process and dimension. The practices are derived from an 
extensive review of the literature, international workshops and 
experience from their application (Marshall 2008). 


Process 

Area 


Process ► 


Dimension 


Practice 
*■ Statements 


Figure 2: Relationships between processes, practices and dimensions 

Table 1 . eMM Version 2.3 Processes (revised from Marshall 2006b) 

Learning: Processes that directly impact on pedagogical aspects of e-learning 

LI . Learning objectives guide the design and implementation of courses. 

L2. Students are provided with mechanisms for interaction with teaching staff and 
other students. 

L3. Students are provided with e-learning skill development. 

L4. Students are provided with expected staff response times to student 

communications. 

L5. Students receive feedback on their performance within courses. 

L6. Students are provided with support in developing research and information literacy 

skills. 

L7. Learning designs and activities actively engage students. 

L8. Assessment is designed to progressively build student competence. 

L9. Student work is subject to specified timetables and deadlines. 

L10. Courses are designed to support diverse learning styles and learner capabilities. 
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Development: Processes surrounding the creation and maintenance of e-learning 

resources 

D1 . Teaching staff are provided with design and development support when engaging 
in e-learning. 

D2. Course development, design and delivery are guided by e-learning procedures 
and standards. 

D3. An explicit plan links e-learning technology, pedagogy and content used in 
courses. 

D4. Courses are designed to support disabled students. 

D5. All elements of the physical e-learning infrastructure are reliable, robust and 
sufficient. 

D6. All elements of the physical e-learning infrastructure are integrated using defined 
standards. 

D7. E-learning resources are designed and managed to maximise reuse. 

Support: Processes surrounding the support and operational management of e-learning 

51 . Students are provided with technical assistance when engaging in e-learning. 

52. Students are provided with library facilities when engaging in e-learning. 

53. Student enquiries, questions and complaints are collected and managed formally. 

54. Students are provided with personal and learning support services when engaging 
in e-learning. 

55. Teaching staff are provided with e-learning pedagogical support and professional 
development. 

56. Teaching staff are provided with technical support in using digital information 
created by students. 

Evaluation: Processes surrounding the evaluation and quality control of e-learning through 

its entire lifecycle 

El . Students are able to provide regular feedback on the quality and effectiveness of 
their e-learning experience. 

E2. Teaching staff are able to provide regular feedback on quality and effectiveness of 
their e-learning experience. 

E3. Regular reviews of the e-learning aspects of courses are conducted. 

Organization: Processes associated with institutional planning and management 

01 . Formal criteria guide the allocation of resources for e-learning design, 
development and delivery. 

02. Institutional learning and teaching policy and strategy explicitly address e-learning. 

03. E-learning technology decisions are guided by an explicit plan. 

04. Digital information use is guided by an institutional information integrity plan. 

05. E-learning initiatives are guided by explicit development plans. 
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06. Students are provided with information on e-learning technologies prior to starting 
courses. 

07. Students are provided with information on e-learning pedagogies prior to starting 
courses. 

08. Students are provided with administration information prior to starting courses. 

09. E-learning initiatives are guided by institutional strategies and operational plans. 


Application of the eMM 

The eMM has been applied in New Zealand across both the university 
(Marshall, 2006a) and vocational sectors (Neal and Marshall, 2008), the 
United Kingdom in both the university (Bacsich, 2006; 2008) and 
vocational sectors (Sero, 2007) and is currently being applied in 
universities in Australia, the United States (Marshall et al. 2008) and 
Japan. In total, nearly 80 different institutions have received assessments 
of their e-learning capability using the eMM. 

Figure 3 below presents a small sample of recent university 
assessments undertaken in New Zealand, Australia, the UK and the USA 
in order to illustrate how the assessments are visualised and how this 
information can be used to assess institutional strengths and weaknesses. 
Each main column in this figure contains the results for a single university 
with black squares indicating Fully Adequate capability, dark blue 
Largely Adequate capability, light blue Partially adequate capability, and 
white no capability. The sub-columns correspond to the five dimensions 
of the eMM ordered from left to right (as shown in Figure 1). Visually, this 
'carpet' of boxes provides a means of reviewing the capabilities of the 
institutions and identifying patterns of capability within or across the 
assessed institutions. The small size of the image helps the analysis by 
encouraging the eye to see the whole pattern, rather than focussing on 
specific processes. Some institutions are clearly more capable (darker) 
than others (lighter), consistent with the different priorities individual 
institutions have placed on e-learning. No institution, however, is entirely 
black or entirely white; all have areas where they could make significant 
improvements in their capability. 

Looking at the column for a single institution visualised in Figure 3, 
such as that for University NZ-B, shows that while some groups of 
processes are relatively strong (such as the block of Learning processes at 
the top), others (such as the Support and Evaluation processes) are not. 
This information can start to guide managers and leaders towards areas 
that may require prioritisation, with the benefit of being visually clear to 
most audiences when explaining the rationale for focusing on those 
issues. 
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Figure 3: eMM assessments of international universities 
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Comparing the institutional assessments in Figure 3 reveals a gradient 
of capability from left to right within each set of results, suggesting 
stronger capability in the Delivery dimension and weakest in the 
Optimization dimension. This can be seen more obviously in Figure 4 
which sorts the assessments by dimension and groups each institutions 
assessment for each dimension together. This clearly shows that while 
capability in the Delivery dimension is generally strong, that in the 
Management and Optimization dimensions is very much less so. This 
reflects the observation that many institutions are struggling to monitor 
and measure their own performance in e-learning (Management 
dimension) and that a culture of systematic and strategically-led 
continuous improvement of e-learning is lacking also (Optimization 
dimension). 

The assessment information can also be displayed on an individual 
process basis to highlight issues that may be common across all 
institutions. The results for these institutions for Process D 7 (E-learning 
resources are designed and managed to maximise reuse) are shown in 
Figure 5. This clearly shows that even in institutions that are otherwise 
very capable (such as university UK-B) this process is not one with strong 
capability. This is consistent with the observation that despite the obvious 
attraction of reuse on cost and efficiency grounds, large-scale adoption of 
reuse approaches such as Reusable Learning Objects has not occurred 
(Barker et al. 2004). This suggests that the conception of reuse in the 
literature has not been persuasive and that in reality a number of 
significant barriers to the creation, storage and reuse of educational 
materials remain. 

Looking at Figure 3, it is also apparent that a band of weak capability 
runs across most institutions in the Evaluation processes. These are 
shown individually in Figure 6. Here, it is apparent that most capability 
is limited to the Delivery dimension of process El (Students are able to 
provide regular feedback on the quality and effectiveness of their e- 
learning experience). The results for processes El and E3 reflects the use 
of pre-existing student feedback mechanisms, but these have not been 
changed to reflect the use of technology by institutions. Commonly, 
institutions are assuming that students will complain if some aspect of 
their e-learning experience is not adequate, rather than actively ensuring 
that students are using the systems to best advantage. This is consistent 
with the overall weak capability noted above in the Management 
dimension. 
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Figure 4: eMM assessments of international universities arranged by dimension 
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D7: Resources created are designed and 
managed to maximise reuse 
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Figure 5: Process D7 capabilities for eleven international universities 


El : Students are able to provide regular 
feedback on the quality and effectiveness of 
their e-learning experience 

E2: Teaching staff are able to provide regular 
feedback on the quality and effectiveness of 
their e-learning experience 

E3: Regular reviews of the e-learning aspects 
of courses are conducted 
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Figure 6: Evaluation process capabilities for eleven international universities 
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By comparison with El and E3, process E2 (Teaching staff are able to 
provide regular feedback on quality and effectiveness of their e-learning 
experience) is weaker still (Figure 6). Very little evidence is seen in most 
institutions of formal and systematic attempts to ensure that staff are able 
to work effectively in e-learning contexts. This lack of engagement with 
the need to develop staff skills is also readily apparent in the results for 
process S5 (Teaching staff are provided with e-learning pedagogical 
support and professional development) shown in Figure 7. These 
assessments reflect the common use of optional workshops and webpages 
without formal assessments of staff skills or any requirement that staff be 
trained in the use of e-learning. 


S5; Teaching staff are provided with e-learning 
pedagogical support and professional 
development 


£ 

o> 

I J 
1 1 1 


1 

51 

8 S a 

University NZ-A 




University NZ-B 




University NZ-C 



zUz 

University NZ-D 




University NZ-E 




University NZ-F 




University NZ-G 





University UK-A 




University UK-B 





| University USA-A 

■ 1 1 i 


| University Aus-A 

II 11 II 


Figure 7: Process S5 capabilities for eleven international universities 


Finally, the weak capability in the Organization processes, especially 
processes 02 (Institutional learning and teaching policy and strategy 
explicitly address e-learning) and 09 (E-learning initiatives are guided by 
institutional strategies and operational) shown in Figure 8, and the 
Management and Optimization dimensions across the entire result set 
(Figure 4) is a concern. It suggests that the leadership of most of the 
institutions assessed have yet to define clear directions for e-learning at 
their institutions. This is consistent with the absence of evidence generally 
that e-learning has radically changed organisational activities (Weedon et 
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al. 2004). Keegan et al. (2006) have also noted that significant innovations 
are commonly linked to external funding and the work of individuals, 
and that long-term organizational impact and sustainability is 
questionable. 


02: Institutional learning and teaching policy 02: Institutional learning and teaching policy 
and strategy explicitly address e-learning and strategy explicitly address e-learning 
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Figure 8: Process 02 and 09 capabilities for eleven international universities 

Discussion 

As outlined above, the eMM combines key features of benchmarking and 
capability maturity models with those of observational e-learning quality 
frameworks in order to create a quality framework for improving 
organisational e-learning maturity. A variety of observational frameworks 
exist to explore the quality of e-learning and it is useful to contrast these 
with the eMM to explain the benefits of the eMM's conception of e- 
learning maturity. 

At the level of the individual innovation there are the well-established 
models of Rogers (2003) and Moore (1999), which provide explanations of 
the adoption of innovation by individuals and provide mechanisms for 
encouraging adoption in the general sense. These are popular as a means 
of describing why so few innovations are adopted, but more work is 
needed to turn this type of model into a tool for enhancing e-learning 
technology use by organizations (Moser, 2007). 

Technology based observational models like those proposed by Taylor 
(2001) and Monson (2005) describe the increasing complexity of 
technology use as new technologies build upon the old. While any 
e-learning model must acknowledge technology, building dependencies 
on specific technologies is risky as it implies that deployment of 
technology drives success; a recipe for expensive failures. There is also the 
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issue that technology is changing at an ever greater pace (Kurzweil, 2005) 
making the maintenance of the currency of such models an ongoing 
challenge. 

Organisationally focussed observation models like CITSCAPE and 
MIT90 (Weedon et al. 2004, de Freitas, 2006) and many "maturity" models 
(Neuhauser, 2004) describe the increasing sophistication of organisational 
engagement with technology supported change and innovation, but in 
merely describing what is happening they fail to provide a mechanism for 
supporting and enhancing that change. 

In contrast, quality assurance frameworks impose a particular, 
normally detailed, compliance model upon organisational activities 
(Chao et al., 2006). Often, they provide a strong description of necessary 
activities in a particular context, including e-learning, but these models 
need constant revision to remain relevant. Compliance models also have 
the problem that the measurement outcomes become potentially more 
important than the improvement of capability, and, compliance is almost 
always a backwards, historical, view of an organization, not something 
that empowers change and growth. 

The eMM, in contrast, provides a mechanism for supporting and 
motivating change. The benchmarking aspects of the model provide a 
clear picture of an organization's current capabilities and describe the 
practices that are needed to improve capability. By providing a clear 
picture of an institution's strengths and weaknesses, combined with a 
pathway for improving capability, the eMM provides a mechanism for 
organizations to determine their own priorities, with sufficient flexibility 
to select technologies and pedagogies that are appropriate to their 
learners, staff and stakeholder expectations. 

In adopting a process driven description of maturity and capability, 
where capability is defined by specific practices, it is essential that the 
warning expressed by Hagner (2001, p. 31) be heeded: 

"...the author had envisioned the presentation of a wide range of 'best 
practices' that would resemble a menu-like opportunity for interested 
institutions to choose from. This original intent was misguided. . . . 'cherry- 
picking' a variety of practices is not recommended. Instead of focusing on 
'best practices', a more profitable emphasis should be placed on 'best 
systems.'" 

Taylor (2001) observed that the challenge facing universities engaging 
in e-learning is not so much about innovation as it is about execution and 
the need to rapidly evolve to sustain change at the pace technology is 
changing. A similar observation has been made by Hamel and Valikangas 
(2003) with their concept of strategic resilience and the need for 
organizations to constantly reinvent their business models and systems 
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before circumstances force change. Institutions need to be ready to 
reinvent themselves and make purposeful and directed changes in 
response to new technologies and pedagogies in order to become more 
'mature', and the eMM is intended to help understand and guide that 
process, evolving itself as our understanding grows. 

Finally, one of the outcomes of the eMM assessments undertaken to 
date has been the illustration of the reality that all institutions have 
particular strengths that can serve as a strong foundation for change and 
which can help others struggling to develop their own capability. 
E-learning, rather than a threat or special form of learning, is potentially 
an opportunity for growth, building on the identified strengths of the 
institution and learning from other institutions, sectors and countries, 
addressing the weaknesses identified by the eMM capability assessment 
and developing into a mature e-learning institution. 
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